Unrepresentative big surveys significantly overestimated US vaccine uptake.

Surveys are a crucial tool for understanding public opinion and behaviour, and their accuracy depends on maintaining statistical representativeness of their target populations by minimizing biases from all sources. Increasing data size shrinks confidence intervals but magnifies the effect of survey bias: an instance of the Big Data Paradox1. Here we demonstrate this paradox in estimates of first-dose COVID-19 vaccine uptake in US adults from 9 January to 19 May 2021 from two large surveys: Delphi-Facebook2,3 (about 250,000 responses per week) and Census Household Pulse4 (about 75,000 every two weeks). In May 2021, Delphi-Facebook overestimated uptake by 17 percentage points (14-20 percentage points with 5% benchmark imprecision) and Census Household Pulse by 14 (11-17 percentage points with 5% benchmark imprecision), compared to a retroactively updated benchmark the Centers for Disease Control and Prevention published on 26 May 2021. Moreover, their large sample sizes led to miniscule margins of error on the incorrect estimates. By contrast, an Axios-Ipsos online panel5 with about 1,000 responses per week following survey research best practices6 provided reliable estimates and uncertainty quantification. We decompose observed error using a recent analytic framework1 to explain the inaccuracy in the three surveys. We then analyse the implications for vaccine hesitancy and willingness. We show how a survey of 250,000 respondents can produce an estimate of the population mean that is no more accurate than an estimate from a simple random sample of size 10. Our central message is that data quality matters more than data quantity, and that compensating the former with the latter is a mathematically provable losing proposition.

COVID-19 Pandemic Impact on the National Health Care Surveys.

While underscoring the need for timely, nationally representative data in ambulatory, hospital, and long-term-care settings, the COVID-19 pandemic posed many challenges to traditional methods and mechanisms of data collection. To continue generating data from health care and long-term-care providers and establishments in the midst of the COVID-19 pandemic, the National Center for Health Statistics had to modify survey operations for several of its provider-based National Health Care Surveys, including quickly adding survey questions that captured the experiences of providing care during the pandemic. With the aim of providing information that may be useful to other health care data collection systems, this article presents some key challenges that affected data collection activities for these national provider surveys, as well as the measures taken to minimize the disruption in data collection and to optimize the likelihood of disseminating quality data in a timely manner. (Am J Public Health. 2021;111(12):2141-2148. https://doi.org/10.2105/AJPH.2021.306514).

Estimating human leishmaniasis burden in Spain using the capture-recapture method, 2016-2017.

Leishmaniasis is endemic and a mandatory reporting disease in Spain since 1982. However, between 1996 and 2014, surveillance on public health was decentralized and only some autonomous regions monitored the disease. The aim of this study is to estimate the incidence of leishmaniasis and to evaluate the extent of underreporting in Spain. A capture-recapture (CRC) study was conducted to calculate the incidence of human leishmaniasis using reports from the National Surveillance Network (RENAVE) and the Hospital Discharge Records of the National Health System (CMBD) for 2016 and 2017. During the study period, 802 cases were reported to RENAVE and there were 1,149 incident hospitalizations related to leishmaniasis. The estimated incidence rates through the CRC study were 0.79 per 100,000 inhabitants for visceral leishmaniasis (VL), 0.88 (cutaneous leishmaniasis (CL)) and 0.12 (mucocutaneous leishmaniasis (MCL)) in 2016 and 0.86 (VL), 1.04 (CL) and 0.12 (MCL) in 2017. An underreporting of 14.7-20.2% for VL and 50.4-55.1% for CL was found. The CRC method has helped us to assess the sensitivity and representativeness of leishmaniasis surveillance in Spain, being a useful tool to assess whether the generalization of leishmaniasis surveillance throughout the Spanish territory achieves a reduction in underreporting.

Practice-site-level measures of primary care comprehensiveness and their associations with patient outcomes.

OBJECTIVES: To develop two practice-site-level measures of comprehensiveness and examine their associations with patient outcomes, and how their performance differs from physician-level measures. DATA SOURCES: Medicare fee-for-service claims. STUDY DESIGN: We calculated practice-site-level comprehensiveness measures (new problem management and involvement in patient conditions) across 5286 primary care physicians (PCPs) at 1339 practices in the Comprehensive Primary Care initiative evaluation in 2013. We assessed their associations with practices' attributed beneficiaries' 2014 total Medicare expenditures, hospitalization rates, ED visit rates. We also examined variation in PCPs' comprehensiveness across PCPs within practices versus between primary care practices. Finally, we compared associations of practice-site and PCP-level measures with outcomes. PRINCIPAL FINDINGS: The measures had good variation across primary care practices, strong validity, and high reliability. Receiving primary care from a practice at the 75th versus 25th percentile on the involvement in patient conditions measure was associated with $21.93 (2.8%) lower total Medicare expenditures per beneficiary per month (P < .01). Receiving primary care from a practice at the 75th versus 25th percentile on the new problem management measure was associated with $14.77 (1.9%) lower total Medicare expenditures per beneficiary per month (P < .05); 8.84 (3.0%) fewer hospitalizations (P < .001), and 21.27 (3.1%) fewer ED visits per thousand beneficiaries per year (P < .01). PCP comprehensiveness varied more within than between practices. CONCLUSIONS: More comprehensive primary care practices had lower Medicare FFS expenditures, hospitalization, and ED visit rates. Both PCP and practice-site level comprehensiveness measures had strong construct and predictive validity; PCP-level measures were more precise.

The EQ-5D-3L administered by text message compared to the paper version for hard-to-reach populations in a rural South African trauma setting: a measurement equivalence study.

INTRODUCTION: Administering patient-reported outcome measures (PROMs) by text message may improve response rate in hard-to-reach populations. This study explored cultural acceptability of PROMs and compared measurement equivalence of the EQ-5D-3L administered on paper and by text message in a rural South African setting. MATERIALS AND METHODS: Participants with upper or lower limb orthopaedic pathology were recruited. The EQ-5D was administered first on paper and then by text message after 24 h and 7 days. Differences in mean scores for paper and text message versions of the EQ-5D were evaluated. Test-retest reliability between text message versions was evaluated using Intraclass Correlation Coefficients (ICCs). RESULTS: 147 participants completed a paper EQ-5D. Response rates were 67% at 24 h and 58% at 7 days. There were no differences in means between paper and text message responses for the EQ-5D Index (p = 0.95) or EQ-5D VAS (p = 0.26). There was acceptable agreement between the paper and 24-h text message EQ-5D Index (0.84; 95% Confidence Interval (CI) 0.78-0.89) and EQ-5D VAS (0.73; 95% CI 0.64-0.82) and acceptable agreement between the 24-h and 7-day text message EQ-Index (0.72; CI 0.62-0.82) and EQ-VAS (0.72; CI 0.62-0.82). Non-responder traits were increasing age, Xhosa as first language and lower educational levels. CONCLUSIONS: Text messaging is equivalent to paper-based measurement of EQ-5D in this setting and is thus a viable tool for responders. Non-responders had similar socioeconomic characteristics and attrition rates to traditional modes of administration. The EQ-5D by text message offers potential clinical and research uses in hard-to-reach populations.

Validation of the Women's Views of Birth Labor Satisfaction Questionnaire (WOMBLSQ4) in the Spanish Population.

The satisfaction of women with the birth experience has implications for the health and wellness of the women themselves and also of their newborn baby. The objectives of this study were to determine the factor structure of the Women's Views of Birth Labor Satisfaction Questionnaire (WOMBLSQ4) questionnaire on satisfaction with the attention received during birth delivery in Spanish women and to compare the level of satisfaction of pregnant women during the birth process with that in other studies that validated this instrument. A cross-sectional study using a self-completed questionnaire of 385 Spanish-speaking puerperal women who gave birth in the Public University Hospitals of Granada (Spain) was conducted. An exploratory factor analysis of the WOMBLSQ4 questionnaire was performed to identify the best fit model. Those items that showed commonalities higher than 0.50 were kept in the questionnaire. Using the principal components method, nine factors with eigenvalues greater than one were extracted after merging pain-related factors into a single item. These factors explain 90% of the global variance, indicating the high internal consistency of the full scale. In the model resulting from the WOMBLSQ4 questionnaire, its nine dimensions measure the levels of satisfaction of puerperal women with childbirth care. Average scores somewhat higher than those of the original questionnaire and close to those achieved in the study carried out in Madrid (Spain) were obtained. In clinical practice, this scale may be relevant for measuring the levels of satisfaction during childbirth of Spanish-speaking women.

Measurement Properties of the CAPACITY Instrument to Assess Perceived Communication With the Health Care Team Among Care Partners of Patients With Cognitive Impairment.

BACKGROUND: The CAregiver Perceptions About CommunIcaTion with Clinical Team members (CAPACITY) instrument measures how care partners perceive themselves to be supported by the patient's health care team and their experiences communicating with the team. OBJECTIVES: The objective of this study was to assess the measurement properties (ie, structural validity of the construct and internal consistency) of the CAPACITY instrument in care partners of patients with cognitive impairment, and to examine whether care partner health literacy and patient cognitive impairment are associated with a higher or lower CAPACITY score. RESEARCH DESIGN: This was a retrospective cohort study. SUBJECTS: A total of 1746 dyads of community-dwelling care partners and older adults in the United States with cognitive impairment who obtained an amyloid positron emission tomography scan. MEASURES: The CAPACITY instrument comprises 12 items that can be combined as a total score or examined as subdomain scores about communication with the team and care partner capacity-assessment by the team. The 2 covariates of primary interest in the regression model are health literacy and level of cognitive impairment of the patient (Modified Telephone Interview Cognitive Status). RESULTS: Confirmatory factor analysis showed the CAPACITY items fit the expected 2-factor structure (communication and capacity). Higher cognitive functioning of patients and higher health literacy among care partners was associated with lower communication domain scores, lower capacity domain scores, and lower overall CAPACITY scores. CONCLUSIONS: The strong psychometric validity of the CAPACITY measure indicates it could have utility in other family caregivers or care partner studies assessing the quality of interactions with clinical teams. Knowing that CAPACITY differs by care partner health literacy and patient impairment level may help health care teams employ tailored strategies to achieve high-quality care partner interactions.

A revised classification algorithm for assessing emergency department visit severity of populations.

OBJECTIVES: Analyses of emergency department (ED) use require visit classification algorithms based on administrative data. Our objectives were to present an expanded and revised version of an existing algorithm and to use this tool to characterize patterns of ED use across US hospitals and within a large sample of health plan enrollees. STUDY DESIGN: Observational study using National Hospital Ambulatory Medical Care Survey ED public use files and hospital billing data for a health plan cohort. METHODS: Our Johns Hopkins University (JHU) team classified many uncategorized diagnosis codes into existing New York University Emergency Department Algorithm (NYU-EDA) categories and added 3 severity levels to the injury category. We termed this new algorithm the NYU/JHU-EDA. We then compared visit distributions across these 2 algorithms and 2 other previous revised versions of the NYU-EDA using our 2 data sources. RESULTS: Applying the newly developed NYU/JHU-EDA, we classified 99% of visits. Based on our analyses, it is evident that an even greater number of US ED visits than categorized by the NYU-EDA are nonemergent. For the first time, we provide a more complete picture of the level of severity among patients treated for injuries within US hospital EDs, with about 86% of such visits being nonsevere. Also, both the original and updated classification tools suggest that, of the 38% of ED visits that are clinically emergent, the majority either do not require ED resources or could have been avoided with better primary care. CONCLUSIONS: The updated NYU/JHU-EDA taxonomy appears to offer cogent retrospective inferences about population-level ED utilization.

Linking Hospital Consumer Assessment of Healthcare Providers and Systems to Swanson Caring Theory: A Diagnostic Model for Improvement.

Given the implications of value-based reimbursement, nurse leaders must thoughtfully assimilate an extraordinary amount of quality, safety, and patient experience data to effectively drive behavioral change. This article proposes Swanson Caring Theory (SCT) as context for Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) improvement strategies. The diagnostic model described herein is not intended to encompass the full scope of nursing care, but rather to help nurse leaders interpret HCAHPS results in terms of the SCT attributes of compassion, competence, and patient well-being.

Conclusions from surveys may not consider important biases: a systematic survey of surveys.

OBJECTIVES: Surveys can inform important health care questions. However, should decision-makers believe strong conclusions that authors of surveys report? Objectives of this systematic survey of surveys are to describe the characteristics and conduct of surveys and investigate the association of the conduct with the conclusions. STUDY DESIGN AND SETTING: We randomly selected 180 surveys published over 1 year in core clinical journals that included a self-report instrument to elicit knowledge, attitudes, behaviors, and experiences regarding health. Study selection and abstraction was independent and in duplicate. We calculated frequencies of descriptive data. We conducted multivariable logistic regression analyses to assess the association of strong or weak conclusions with survey methods. RESULTS: Our results suggest that authors who validate questions in their survey make strong conclusions. We found that strong conclusions may not be associated with response rates or number of respondents. However, it did not appear that journal impact factor was related to strong conclusions. CONCLUSION: Our results suggest that users of surveys should not rely on the conclusions of authors. A critical appraisal tool for users of surveys and guidance for authors about factors to consider when making conclusions would be helpful.

The Italian Version of SCORE-15: Validation and Potential Use.

SCORE-15 (Systemic Clinical Outcome and Routine Evaluation) is a 15-item questionnaire for completion by family members aged 12 years and older to assess outcomes in systemic therapy. This study aimed to investigate (a) the psychometric properties and the internal consistency reliability of the Italian version of SCORE-15, (b) clinical responsiveness, and (c) normative (Italian) criteria. Furthermore, (d) the study sought to evaluate the participants' representation of both their family and their problems, analyzing open-ended questions included in the SCORE-15. Data were collected from two clinical centers for 208 families (n = 507). Results confirmed the three-factor structure (i.e., strengths, difficulties, and communication), a good internal consistency reliability, and indicated a cutoff threshold for the Italian version. Furthermore, results showed that SCORE-15 is a good instrument for clinical responsiveness and that it can be used to explore the way in which family members describe their families and problems. Overall, SCORE-15 is a brief, psychometrically robust family assessment instrument that may be used for both researchers and practitioners in several domains of clinical and social psychology.

El SCORE-15 (Evaluación de Rutina y Resultados Clínicos de la Terapia Sistémica) es un cuestionario de 15 preguntas para que lo contesten los miembros de la familia mayores de 12 años a fin de evaluar los resultados de la terapia sistémica. Este estudio tuvo como fin investigar a) las propiedades psicométricas y la consistencia interna fiabilidad de la versión italiana del SCORE-15, b) el grado de respuesta clínica y c) los criterios normativos (italianos). Además, (d) el estudio se propuso evaluar la representación de los participantes de su familia y sus problemas, analizando preguntas abiertas incluidas en el SCORE-15. Se recopilaron datos de dos centros clínicos para 208 familias (n = 507). Los resultados confirmaron la estructura de tres factores (p. ej.: puntos fuertes, dificultades y comunicación), una buena consistencia interna fiabilidad y indicaron un tope para la versión italiana. Además, los resultados demostraron que el SCORE-15 es un buen instrumento para evaluar el grado de respuesta clínica y que puede utilizarse para analizar la forma en la que los familiares describen a sus familias y a sus problemas. En general, el SCORE-15 es un instrumento de evaluación familiar breve y psicométricamente sólido que puede utilizarse tanto para los investigadores como para los profesionales en varias áreas de la psicología clínica y social.

Ensuring Taiwan patient safety culture survey is free from differential item functioning.

BACKGROUND: Differential item functioning (DIF) means the interference of some demographic characteristic or grouping of the tight relationship between trait levels. DIF threatens precise interpretations of survey results and makes them unreliable. The aim of this study was to examine whether the succinct version of Taiwan Patient Safety Culture (TPSC-S) survey is free from DIF and to mitigate its impact if needed. METHODS: The TPSC-S survey results of 2964 respondents in a public hospital in Taiwan were analyzed. The existence, type, and effect size of DIF were examined for each TPSC-S item using a proportional-odds logistic regression method between characteristic groups, including gender, work experience, job types, management roles, employment status, and safety reporting experiences. RESULTS: The study results revealed that several items of TPSC-S showed statistically significant DIF between characteristic groups. Nevertheless, the magnitude of these DIF was small, and their influence to TPSC-S survey was not significant. The domain-level DIF impact was completely insignificant for all characteristic groups. CONCLUSION: This study revealed that the 24-item TPSC-S survey was free from DIF in six characteristic groups. The difference in survey scores between groups stems from the real difference that hospital safety managers want to measure.

Evaluation of safety attitudes of hospitals and the effects of demographic factors on safety attitudes: a psychometric validation of the safety attitudes and safety climate questionnaire.

BACKGROUND: The objectives of this study are to test the psychometric properties of the safety attitudes and safety climate questionnaire Chinese simplified version (SAQ-CS), to test the safety attitudes of health professionals in tertiary hospitals in the Liaoning province and to explore the effects of demographic factors on safety attitudes. METHODS: The SAQ-CS was used to conduct a cross-sectional survey in nine tertiary hospitals in Liaoning province. RESULTS: Cronbach's alpha of each subscale of SAQ-CS were > 0.7, the values of GFI, TLI, and CFI were > 0.8, and RMSEA values ranged from 0.048-0.199. The mean of the safety attitudes of 2157 health professionals was 4.00, indicating a good safety attitude, with a positive response rate (% of items that scored ≥4) of 51.1%. The stress recognition subscale had the lowest score, with a mean of 2.73 and a positive response rate of 17.8%. A multiple linear regression equation revealed that demographic factors like gender, age, and training participation significantly affected the scores (ßgender > 0.06, ßage < - 0.08, ßtraining < - 0.07, p < 0.05). CONCLUSIONS: The psychometric properties of SAQ-CS are good and stable. Health professionals rate teamwork climate, safety climate, perception of management, and work conditions in Liaoning province are perceived as good; however, the stress of the health professionals is poor. To improve safety attitudes, it is necessary to not only reduce the stress of health professionals, but also to pay more attention to men, older health professionals, and health professionals who have not participated in safety training.

«Safety First¼: Design of an anesthetic checklist in pediatrics. / «Safety First¼: diseño de un checklist anestésico en pediatría.

INTRODUCTION: Quality improvement in health care entails the design of reliable processes which prevent and mitigate medical errors. Checklists are cognitive tools which reduce such errors. The primary objective of this study was to design an anesthetic checklist in Pediatrics to be implemented in our hospital. METHODS: Delphi technique was used, with 3 rounds of questionnaire surveys: a generic questionnaire to obtain dimensions and items; and 2 specific ones to score individual items and obtain an overall rating for the checklist (median), and to measure the level of consensus (relative interquartile range) and internal reliability (Wilcoxon signed-rank test). RESULTS: Final version of the checklist obtained a high overall score (Med 9) with a very high consensus (RIR 5%). Internal consensus was reached on all items (RIR ≤ 30%). Wilcoxon signed-rank test found no statistically significant differences, demonstrating reliability or consistency of responses between consecutive rounds. CONCLUSION: The Anesthetic checklist in Pediatrics has been methodically designed for implementation and use in our hospital.

Reliability and Validity of the Vicarious Trauma Organizational Readiness Guide (VT-ORG).

The Vicarious Trauma Organizational Readiness Guide (VT-ORG) is an assessment of an organization's readiness to address vicarious trauma (VT), which is exposure to the traumatic experiences of people served. This study reports on the psychometric properties of the VT-ORG. Employees of first responder agencies (e.g., law enforcement, fire, emergency services) and victim assistance agencies are at a high risk for vicarious traumatization, which can lead to PTSD, substance use, and suicidal ideation, among other negative impacts. Organizations that do not address VT may see such effects as employee turnover, reduced efficiency, and negative work environments. The VT-ORG is an assessment tool designed to help organizations complete the first step of organizational change-conducting a needs assessment. Study participants were 3,018 employees across 13 first responder and victim assistance agencies who completed the 67-item VT-ORG and additional measures for evaluation of its validity and reliability. The VT-ORG was found to have excellent internal consistency (Cronbach's α = .98). A structural equation model demonstrated that the subscales of the VT-ORG predicted criterion measures of turnover intention, compassion satisfaction, and organizational resilience, with an overall model fit of CFI = .99, RMSEA = .053. This study found the VT-ORG to be a reliable and valid assessment of organizational responses to vicarious trauma.

Validating Reports of Chronic Conditions in the Medicare CAHPS Survey.

BACKGROUND: The Medicare Consumer Assessment of Healthcare Providers and Systems (CAHPS) survey includes items about chronic conditions, health history, and self-rated health. Questions remain about the concordance between patient reports and administrative sources on questions related to health history. OBJECTIVE: To validate CAHPS measures of chronic conditions against claims-based measures from the Medicare Chronic Conditions Warehouse (CCW). METHODS: We linked CAHPS responses from 301,050 fee-for-service Medicare beneficiaries in 2010-2012 with summaries of their claims in the CCW and identified nearest equivalent measures of conditions across sources. We calculated sensitivities and specificities for conditions and estimated regression models to assess the effects of patient characteristics on the sensitivity. RESULTS: The sensitivity of CAHPS measures differed across conditions, ranging from 0.513 for history of stroke to 0.773 for history of cancer. Sensitivity was generally lower for older beneficiaries, those reporting good self-rated health, and those with fair or poor mental health. Specificity was 0.904 or greater for all conditions, up to 0.961 for stroke. CONCLUSIONS: Despite difference in timeframes and definitions of conditions, the measured sensitivities demonstrated reasonable validity. Variation in sensitivity is consistent with covariates that either directly measure health severity within a diagnosis or can be construed as a proxy for severity of illness.

The effects of survey version on patient experience scores and plan rankings.

OBJECTIVE: To assess the effect of changing survey questions on plan-level patient experience measures and ratings. DATA SOURCE: 2015 Medicare Advantage CAHPS Survey respondents. STUDY DESIGN: Ninety three randomly selected beneficiaries in each of 40 MA plans received a revised (5.0) CAHPS survey; 38 832 beneficiaries received version 4.0. Linear mixed-effect regression predicted CAHPS measures from fixed effects for survey version and beneficiary characteristics and random effects for plan and plan-by-version random slope. PRINCIPAL FINDINGS: Response rates were 42 percent for both versions. Removal of "try to" from screeners increased the percentage of respondents eligible for follow-up questions. Version 5.0 caused a small increase (1-3 points on a 0-100 scale, P < 0.05) in the mean of three altered measures and a moderate increase (>3 points) in one. There was a small statistically significant increase in two unaltered measures. These changes were uniform across plans, so there would be no expected change compared to results using the legacy survey in the score distributions other than uniform mean shifts, and no expected effect on summary measures. CONCLUSIONS: These analyses illustrate how to assess the impact of seemingly minor survey modifications for other national surveys considering changes and highlight the importance of screeners in instrument design.

The effect of different sampling and recall periods in the CAHPS Clinician & Group (CG-CAHPS) survey.

OBJECTIVE: To examine the effect of changing the sampling and reference periods for the CAHPS® Clinician & Group Survey from 12 to 6 months. DATA SOURCES/STUDY SETTING: Adult patients with a visit in the last 12 months to New England community health centers. STUDY DESIGN: We randomly assigned patients to receive a survey with either a 12- or 6-month recall period. DATA COLLECTION/EXTRACTION METHODS: Questionnaires were mailed to patients, with a second questionnaire mailed to nonrespondents, followed by six attempts to complete a telephone interview. PRINCIPAL FINDINGS: If the sampling criterion was a visit in the last 6 months, 9 percent of those with a visit in the last 12 months would not have been surveyed. A total of 1837 patients completed 6-month surveys (44.9 percent response rate); 588 completed 12-month surveys (46.0 percent response rate). Shortening the reference from 12 to 6 months reduced the proportion of respondents reporting a blood test, X-ray, or other tests. Adjusting for respondent characteristics, the most positive response was selected more often on the 6-month survey for 12 out of 13 questions, and three of these differences were statistically significant (P < 0.05). CONCLUSIONS: Surveys using a 6-month recall period may yield slightly higher scores than surveys with a 12-month recall period.

Differences in Consumer Assessment of Healthcare Providers and Systems Clinician and Group Survey Scores by Recency of the Last Visit: Implications for Comparability of Periodic and Continuous Sampling.

BACKGROUND: Patient experience data can be collected by sampling patients periodically (eg, patients with any visits over a 1-year period) or sampling visits continuously (eg, sampling any visit in a monthly interval). Continuous sampling likely yields a sample with more frequent and more recent visits, possibly affecting the comparability of data collected under the 2 approaches. OBJECTIVE: To explore differences in Consumer Assessment of Healthcare Providers and Systems Clinician and Group survey (CG-CAHPS) scores using periodic and continuous sampling. RESEARCH DESIGN: We use observational data to estimate case-mix-adjusted differences in patient experience scores under 12-month periodic sampling and simulated continuous sampling. SUBJECTS: A total of 29,254 adult patients responding to the CG-CAHPS survey regarding visits in the past 12 months to any of 480 physicians, 2007-2009. MEASURES: Overall doctor rating and 4 CG-CAHPS composite measures of patient experience: doctor communication, access to care, care coordination, and office staff. RESULTS: Compared with 12-month periodic sampling, simulated continuous sampling yielded patients with more recent visits (by definition), more frequent visits (92% of patients with 2+ visits, compared with 76%), and more positive case-mix-adjusted CAHPS scores (2-3 percentage points higher). CONCLUSIONS: Patients with more frequent visits reported markedly higher CG-CAHPS scores, but this causes only small to moderate changes in adjusted physician-level scores between 12-month periodic and continuous sampling schemes. Caution should be exercised in trending or comparing scores collected through different schemes.